"The highlighted tokens are predominantly Thai morphemes, syllables, or short words that serve as key semantic units within compound words, proper nouns, or technical terms. These tokens often appear at the beginning or within multi-syllabic constructions, marking important grammatical, nominal, or conceptual boundaries in the text. Their selection reflects the agglutinative and compounding nature of Thai, where meaning is built from smaller, meaningful units."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.78 | 1.0 | 0.56 | 0.718 | 0.56 | 1.0 | 0.0 | 0.44 |
fuzz | 0.81 | 1.0 | 0.62 | 0.765 | 0.62 | 1.0 | 0.0 | 0.38 |